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In this paper we prove a sharp quantitative version of the Kendall's Theo- 
rem. The Kendal Theorem states that under some mild conditions imposed on a 
probability distribution on positive integers (i.e. probabilistic sequence) one can 
prove convergence of its renewal sequence. Due to the well-known property - the 
first entrance last exit decomposition - such results are of interest in the stability 
theory of time homogeneous Markov chains. In particular the approach may be 
used to measure rates of convergence of geometrically ergodic Markov chains and 
consequently implies estimates on convergence of MCMC estimators. 
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1 Introduction 



Let (X n ) n ^ be a time- homogeneous Markov chain on a measurable space (S,B), with 
transition probabilities P n (x, •), n ^ and a unique stationary measure ir. Let P be 
the transition operator given on the Banach space of bounded measurable functions on 
(«S, B) by Pf(x) = f f(y)P(x, dy). Under mild conditions imposed on (X n ) n ^ the chain 
is ergodic, i.e. 

||P n (av) -7r(-)||2v-> 0, as n^oo, (1.1) 
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for all starting points x G S in the usual total variation norm 

\\h\\tv = sup I / fdfi\, 

where p is a real measure on (S,B). It is known that the aperiodicity, the Harris 
recurrence property and the finiteness of 7r are equivalent to (11. ip . (see Theorem 13.0.1 
in [12] )• Consequently the recurrence property is necessary to prove the convergence of 
X n distributions to the invariant measure in the total variation norm regardless of the 
starting point Xq = x. In applications (see [11]) there is required a stronger form of 
the result, namely we expect the exponential rate of the convergence and a reasonable 
method to estimate this quantity. 

One of the possible generalizations of the total variation convergence is considering func- 
tions controlled from above by V : S — > R, V ^ 1, 7r(V) < oo therefore we refer to By as 
the Banach space of measurable functions on (S,B), such that sup x&s \f(x)\/V(x) < oo 
with the norm 

i m i 1/0*01 
WfWv ■= sup-——. 
xes V[x) 

Then instead of the total variation distance one can use 



fi\\v := sup | / fdp\. 
\f\<v J 



\f\<v 

The geometric convergence of P n (x, •) to a unique stationary measure ir, means there 
exists pv < r ^ 1 such that 

\\(P n g)(x) - J gd7T\\ v ^ M v (r)r n \\g\\ v g G B v , (1.2) 

where pv is the spectral radius of (P — 1 <S> 7r) acting on (By, \\ ■ \\b) and My(r) is the 
optimal constant. In applications we often work with test functions g from a smaller 
space Bw, where W : S — > IR and 1 ^ W ^ V. In this case we expect 

\\{P n g){x) - [ gdn\\y ^ M w (r)r n \\g\\ w , geB 



w, 

which is valid at least on py ^ r ^ 1, and My/(r) is the optimal constant. The most 
important case is when W = 1, i.e. we consider not necessarily uniform geometric 
convergence in the total variation norm. 

Whenever it exists we call py the convergence rate of geometric ergodicity for the chain 
(X n )„^Q. For a class of examples one can prove the geometric convergence (see Chapter 
15 in [12]) and it is closely related to the existence of the exponential moment of the 
return time for a set C G B of positive 7r-measure. 
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The main tool to measure the convergence rate of the geometric ergodicity is the drift 
condition, i.e. the existence of Lyapunov function V : S — >■ R, V ^ 1, which is con- 
tracted outside a small set C. The standard formulation of the required properties is the 
following: 

1. Minorization condition. There exist C G B, b, b > and a probability measure v 
on (<S, B) such that 



for all x e C and A e B. 

2. Drift condition. There exist a measurable function V : S — > [1, oo) and constants 
A < 1 and K < oo satisfying 



3. Strong aperiodicity bv(C) ^ 6 > 

The first property means there exists a small set C on which the regeneration of (X n ) n ^ 
takes place (see Chapter 5 in [T2] ). The assumption is relatively week since each Harris 
recurrent chain admits the existence of a small set at least for some of its m-skeletons (i.e. 
processes (X nm ) n ^o, m ^ 1) - see Theorem 5.3.2 in [12]. The small set existence is used 
in the split chain construction (see Section [6] and cf. [10J for details) to extend (X n ) n ^ 
to a new Markov Chain on a larger probability space S x {0, 1}, so that (C, 1) is a true 
atom of the new chain and its marginal distribution on (S, 0) equals the distribution of 
(X n ) n ^Q. The second condition reads as the existence of a Lyapunov function V which 
is contracted by the semigroup related operator P with the rate A < 1, for all points 
outside the small set. Finally the strong aperiodicity means that the regeneration set C 
is of positive measure for the basic transition probability, so the regeneration can take 
place in one turn. 

Our main result concerns ergodic Markov chains. Since the approach is based on the 
reduction to the study of a renewal sequence, we first consider the atomic case and show 
how the idea works in this special case. Then we turn to the general case where the split 
chain construction is required. The results of the type are used whenever exact estimates 
on the ergodicity are required cf. [3], [S] and jH]- 

The organization of the paper is as follows: in Section [2] we discuss the atomic case 
where we describe our main results in this case, then in Section [3] we say what can be 
done with a method of chain splitting in the general case. In Section H] we give the 



P(x, A) ^ bu(A) 
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proof of our main result - Theorem I2.8( in Section we discuss how the result improves 
the previously known estimation methods. In section |6] we show how the Kendal type 
results can be used in Markov theory to estimate rates of convergence. We give a short 
argument for both the atomic and non atomic case, leaving the tedious computation of 
some estimates of constants (which improves what has been known) to the Appendix 
A. Then in Appendix Btes of constants (which improves what has been known) to the 
Appendix A. Then in Appendix B we analyze the result for typical toy examples. 

2 The atomic case 

For this section we assume that 6 = 1. Note that in this setting one can rewrite the 
minoriziation condition [T] as 



which implies that C is an atom and v = P(a, •), for any a G C. It remains to translate 
conditions [2J13] into a simpler form which can be used later to prove the geometric ergod- 
icity. Let r = r(C) = inf{n ^ 1 : X n G C} and u n = P a (X n G C), for n ^ 0. Then 
u n is the renewal sequence that corresponds to the increment sequence b n = P a (r = n) 
for n ^ 1. Note that in particular whenever we expect ergodicity ]xm n -+ 00 u n exists and 
is equal = 7r(C). Following [1] we define function G(r,x) = E x r T , for all x G S and 
< r < A -1 . The main property of G(r, x) is that it is the lower bound for V(x) on the 
set S\C, namely we have that (cf. Proposition 4.1 in [1]) 

Proposition 2.1 Assume only drift condition (Uj). 

1. For all x G S, P x .(r < oo) = 1. 

2. ForlCr < A" 1 



The renewal approach is based on the first entrance last exit property. To state it we need 
additional notation H w (r,x) = E x (^]^ =1 r"T4 / (X„)), for r > for which the definition 
makes sense. We have that (cf. Proposition 4.2 in pQ) 

Proposition 2.2 Assume only that the Markov chain is geometrically ergodic with (unique) 
invariant probability measure tt, that C is an atom and that W : S — > R is such that 



P(x,A) 



u(A), forallxGC. 
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W ^ 1. Suppose g : S — > K. satisfies \\g\\w ^ 1; ^ en / or all r ^ 1 for which right-hand 
sides are finite: 



oo „ 

sup | T( pn 9( a ) - / 9d7r)z n \ ^ 



^ H w {r } a) sup | - Woc)<2™| + 7r(C)" l! 

1*1^ n^O 



H w (r, a) - rH w (l, a) 



r — 1 



/or all a £ C and 



oo „ 

sup | V(P n o(x) - / advr)^! < 
1-1='" t^i 

oo 

< /fw(r, x) + G(r,x)H w (r,a)\ sup 7 (tt n - Uoo)z n \+ 

+ 7r(C) G(r, x) + 7r(C/)iJ w (l,a) , 

r — 1 r — 1 

/or all x qLC . 

Now the problem splits into two parts: in the first one we have to provide some estimate 
on Hyy(r, x), x G S on the interval 1 ^ r ^ A -1 , and it is of meaning when we want to 
obtain a reasonable bound on Mw{r), whereas in the second we search for ro a lower 
bound for the inverse of the radius of convergence of ^2^ =0 (u n — Uoo)z n , and then for 
some upper bound K (r) on sup| 2 | =r | ^m =0 (u n — u oo) zn \, for r < r . 
As for the first issue we acknowledge two cases. The simplest situation is when W = 1 
and therefore Hi(r,x) = r(G(r,x) — l)/(r — 1), Hi(l,a) = E a r = 7r(C) _1 , which allows 
to slightly improve estimates on Hi(r,x) (cf. Proposition 4.2 in [Tj). 

Proposition 2.3 Assume only drift condition (TJ|). 

1. Forl^r ^ A" 1 

H\(r, x) ^ 



* G C. 



2. and for 1 ^ r ^ A 



-1 



Fx(r, a) - rF x (l, a) < r\{K - 1) 



r-1 (1-A) 2 ' 

Combining estimates from Propositions 12.11 and 12.31 with Proposition 12.21 we obtain 
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Theorem 2.4 Suppose (X n ) n ^ satisfies conditions U§3 with 6 = 1. Then (X n ) n ^ is 
geometrically ergodic - it verifies hl.2\) and we have the following bounds on py , M\: 

Pv < ro 1 

, . 2rA rX(K-l) r(K - A) r ^ , , 
where r = r (6, A -1 , A^ 1 ^) and -Ko( r ) = -^o( r ; A -1 , X -1 iT) are defined in Corollaries 

On the other hand when W = V we have weaker bounds on Hy(r), which are given in 
Proposition 4.2 in p]. 

Proposition 2.5 Assume only drift condition (TJ|). 
1. For 1 < r < A" 1 



Hv(r,x) ^ < r{K '_ rX) 



in particular Hy(l, x) ^ yfy /or all x E C . 
2. and for 1 ^ r ^ A -1 

H v {r, a) - rH v (l, a) ^ r\{K - 1) 



r-1 (l-A)(l-rA)' 

Applying Proposition 12.51 instead of 12.31 we obtain a similar result to Theorem 12.41 yet 
with a worse control on Mw(r) (that necessarily goes to infinity near r = A -1 ). 

Theorem 2.6 Suppose that (X n ) n ^o satisfies conditions [MM with 6 = 1. Then (X n ) n ^o 
is geometrically ergodic - it verifies hl.2\) and we have the following bounds on py, My: 

Pv < r 1 

, , rA rX(K-X) r\(K - 1) r(K — rA) 

where ro = ro(6, A -1 , A -1 ^) and -Ko( r ) = Ko(r, 6, A -1 , A If) are defined Corollaries 
\2~9J2~m 

The second part concerns the study of a renewal process. As we have noted when- 
ever the condition (J2J) holds we can handle with all quantities in Proposition 12.21 but 
sup| 2 | s g r | J2^=o( u n ~ Uoo)z n \. Let (rfc)fc^o denote subsequent visits of the Markov chain 
to C, where we assume that r = (so the chain starts from C). The renewal process 
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is denned by V m = inf{r„ — m : r n ^ m}, m ^ 0. Clearly 7% — Tfc_i, k ^ 1 forms a 
family of independent random variables of the same distribution P a (r/ C — Tk-i = n) = 
P a (r = n) = b n , n ^ 1. By the definition we have the equality P(V n = 0) = u n , i.e. 
the probability that the process renew in time n equals u n . Observe that Uq — 1 and 
u n = Y2=i u n-kh, hence denoting b(z) = Y.n=i b nZ n , u(z) = Y.n=o u n zTl i for ^ C, we 
can state the renewal equation in the following form 



The equation means we can study the convergence of u n to in terms of properties of 
{b n )n^i- Note that b\ = P a (r =1)^6 and &(A _1 ) ^ by the conditions respectively 

[T] and 121 Historically, the first result that matches these properties with the geometric 
ergodicity was due to Kendall [6] who proved that: 

Theorem 2.7 Assume that b\ > and Y^=i b n r n < 00 for some r > 1. Then the 
limit — h m n-s>oo u n exists and is equal = (XZ^Li n ^n) _1 ; moreover the radius of 
convergence ofY^ =Q (u n — u ^)z n is strictly greater than 1. 

Although the result shows that drift condition implies the geometric ergodicity of an 
aperiodic Markov Chain, it is not satisfactory in the sense that it does not provide neither 
estimates on the radius of convergence nor a deviation inequality which one could use on 
the disc where the convergence holds. The Kendall's theorem was improved first in [13] 
and then in |TJ (see Theorem 3.2). There are also several results where some additional 
assumptions on the distribution of r are studied. For example in [2] there is described how 
to provide an optimal bound on the rate of convergence, which gives some computable 
bound on the value, yet under additional conditions on the r distribution. Whenever the 
general Kendall's problem is considered the bounds obtained in the mentioned papers 
are still far from being optimal or easy to use. The goal of the paper is to give a sharp 
estimate on the rate of convergence which significantly improves on the previous results. 
Our approach is based on introducing tc(C) as a parameter, namely we prove that the 
following result holds: 

Theorem 2.8 Suppose that (& n )^i verifies bi ^ b > 0, b(r) = J2™=i ^rJ 71 < °°> f or 
some r > 1. Then -u^ = (X^°=i ^n) -1 and 



u{z) = 1/(1-6(2)), for |*| < 1. 



(2.1) 



00 



c(r) — c(l) 




c(l)(r - - b)D(a) - c(r) + c(l)} + ) 



where c(r) 



b(r)-l 
r-l ' 



C(l) = U 



oo 



1 



7r(C) 1 and 



Consequently whenever one can control c(r) = (b(r) — l)/(r — 1) from above, there is a 
bound on the rate of convergence for the renewal process. The simplest exposition is when 
c(l) = 7r(C) _1 is known and we can control c(r) in a certain point, i.e. c(R) ^ N < oo, 
for some R > 1. Observe that if ^ L, then due to c(R) = we deduce that 

c(R) ^ N = |Pj, which is our basic setting. Note that by the Holder inequality, for all 
1 < r < R 

c(r) - c(l) ^ (c(l) - - 1) < (1 - 6)a(r*W - 1), 

where «(a) = log(^)/logi? = log(^)/ logfl, a = (c(l) - 1)/(1 - b). 

Corollary 2.9 Suppose that c(l) = 7r(C) _1 given, b\^b and b(R) ^ L, then 

D(a) i 

r = mini/?, (1 + — L^)^y}. (2.2) 
a 

Moreover for r < r 

i(C)(r fi W - 1) 



sup | ^2(u n - Moo)2; n | ^ iT (r) 



W=r — (r-l)( a -iL>(a)-r"(«) + l)' 

Remark 2.10 Observe that the bound (1 + increasing with b assuming that 

L,R,c(l) are fixed. 

In applications we have to treat c(l) = 7r(C) _1 as a parameter. The advantage of the 
approach is that there is a sharp upper bound on c(l) or rather a = (c(l) — 1)/(1 — 6). 
Using the inequality 

K ~ K ^ 1-6 ^ (l-b)R ^(l-b)R> [ 6) 

we obtain that a ^ q;q, where a = log(^f^)/ logi?. On the other hand if b = bi, 
then c(l) — 1 ^ 1 — 6 and therefore due to Remark 12.101 we can always require that 
c(l) — 1^1 — 6. Consequently to find an estimate on the rate of convergence we search 
(1 + ^^-) K(a) , ct G [1, ao] for the possible minimum. 

Corollary 2.11 Suppose that b\^b and b(R) $C L. JTien 

r =min{i?, min (H — (2.4) 

Moreover for r < ro 

~ r «(a) _ ! 

sup I > (u n — Ur X> )z n \ ^ ifnfr) = m ax — — T — ^ (2.5) 

\z\=r ^ i^ao (r-l)(a- 1 D(a)-r K ( Q ) + l) v ; 

The above Corollary should be compared with Theorem 3.2. in [I]. In section [5] we 
prove that our result is always better than the previous one, moreover we discuss the 
true benefit of the approach studying the limiting case, where R — > 1. 



8 



3 Non atomic case 



In the general case we assume 6^1, which means that true atom may not exists. 
Therefore we have to use the split chain construction to create an atom on the extended 
probability space. In the Section E] we prove Theorems IA.6I and IA. 81 that are equivalents 



of Theorems 12.41 and 12.61 in the case of general ergodic Markov chain. Consequently 
applying the first entrance last exit decomposition for the split chain we reduce the 
question of the rate of convergence to the study of the renewal sequence for (6 n )n>i - the 
probability distribution of the return time to the artificial atom. 

Let (u n ) n ^o be the corresponding renewal sequence for (b n ) n ^i. In the same way as 
in the atomic case let b(z), u(z), z G C be corresponding generating functions and 
c( z ) = (b(z) - l)/0 - 1). Clearly h = bv{C) > b, and c(l) = so as in the 

atomic case we have a control on the limiting behavior of c(z) — c(l), namely applying 



Theorem 12.81 we obtain that whenever c(r) < oo, then 

supig(^-«oo)^| < c - (1)(r _ 1)([(1 _ 6)D( «)_ c - (r) + c - (1)]+) ' (3- 1 ) 
where c(r) = b ^'_~ 1 , c(l) = w^ 1 = b~ 1 n(C)~ 1 and 

n ,-, |i + A(i-e^)|-i , - ^1^-1 

Via) = , where a 



e i+o 



1-b 



In this way the problem reduces to the estimate on b(r). The main difficulty is that in 
the non atomic case Theorem [2] provides only that for R = A -1 > 1 

b x (R) = E X R T ^L = KR, for all x e C, (3.2) 

whereas we need a bound on the generic function of (b n )n^i- We discuss the question 
in Section^ showing in Proposition IA.2I that for all 1 ^ r ^ min{/2, (1 — b) } the 
following inequality holds 

, , , , , br br + (b — b)r 1+a2 . 
b(r) ^ L(r) = max{ =— , K — L- }, 3.3 

where at = log(^fgj)/ hgR and a 2 = log(^gfg^)/ hgR. Moreover if 1 + b ^ 2b 
then simply 

br 

L{r) 



1 - (1 - b)r 1+a ^ 

Using (13. 3 p is the best what the renewal approach can offer to bound b(r). The meaning 
of the result is that there are only two generic functions that are important to bound 
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b(r). If b is close to 1 then we are in the similar setting as in the atomic case and surely 

+(l-b)r 1+a 2 
l-(l-b)r ' 



one can expect the bound on 6(r) of the form br+ }'\-, b \ ) — -, whereas if 6 is far from 1 only 



the split chain construction matters and the bound on 6(r) should be like y 

As h 
that 



br 



(l-6)r 1+Q i 

As in the atomic case we will need a bound on the a = — rzr^ • We show in Corollary IA.3I 



7-1 1 — 6 6 — 6 

a^b max{- -(1 + ai),- - + - -a 2 }. (3.4) 

1 — l — o l — o 

In fact the maximum equals 6 -1 yEf (1 + a i) if 1 + 6 ^ 26 and 6~ 1 y^| + jE^ a 2 otherwise. 

Now we turn to the basic idea for all the approach presented in the paper. Observe that 

5(1)- 



c f2_\ satisfies the Holder inequality i.e. for p + q = 1, p, q > 



> c(ri) - l )p( c(r 2 ) -l )q c(rjVf ) - 1 
c{l)-l' c(l)-l ' ' c(l)-l ; 

c(e x ) 
5(1)- 



which means that F (x) = \og( c ^_^ ) is convex and F (0) = 0. By (I3.3P we have that 
c(e x ) < L(e x ) and hence 



F (x) < F a (s) = log( f - ). (3.5) 

(1 — 6)a(e :c — 1) 

Therefore we can easily compute the largest possible function F(x) that satisfies the 
conditions: 

1. F(x) sC Fi(x) for < x < minjlog.R, - T7 ^ 7 log(l - 6)}; 

2. -F(O) = and F is convex; 

3. F is maximal over the functions with the properties 1-2, namely if there ex- 
ists F that satisfies the above condition then F(x) ^ F(x) for all ^ x ^ 
min{log J R,- TT ^log(l -6)}. 

Let Xq be the unique solution of the equation 

F[{x)x = F 1 (x). (3.6) 

Note that xq ^ — r^rr l°g(l — 6). If additionally Xo ^ logi? then the optimal F(x) is of 
the form 

p( x ) - J F K x o) x for a11 ^ x ^ x ^ ^ 

) Fi(x) for all Xo ^ x ^ minjlogi?, — yy^-log(l — 6)} 

otherwise if xo > log R then 

F(x) = Fl ^ 0g ^ x for all < x < log A (3.8) 
log it 
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To make the notation similar to the atomic case let n(a,r) = F \ log ^ . In particular if 



logr < xq ^ \ogR then n(a,r) = F{(xq) and similarly n(a,r) = F [^^ if log-R < xq. 



logr 

y R(a, r) = 

The above discussion leads to the following conclusion: 

c(r) - c(l) < (1 - b)ar K{ ^ r \ for all 1 ^ r < minjtf, (1 - 6) _I ^T} (3.9) 

furthermore r) as a function of r is constant at least on the part of the interval 

_ i 

[l,min{i?, (1 — b) }]. Consequently applying (13. II in the case where 7r(C) is known 
we obtain our main estimate in the non-atomic case. 

Theorem 3.1 Suppose that bi ^ b and b(r) satisfies Ii3.3\) . and 7r(C) is known. Then 

f = min{i?, (1 — b) , f (a)}, 
where f (a) is the unique solution of the equation 

r — (1 H — ) s(t5 - r) • 

a 

Moreover for r < ro 

^(Cf)( r R ( a ' r ) - 1) 



CO 



^2(Un -Moo)^"| < ifo(r) 
n=0 

Remark 3.2 Observe that if 



sup 



(r - l)(<xD(a) - r s ( <5 - r ) + 1) ' 



log(l + £Q.)/F{(x ) ^x ^ \ogR, (3.10) 

a 

then f = (1 + F ' l(xo) ■ Due to \3. 6}) , the condition 113.10]) is equivalent to x ^ log-R 
and 

D(a) L(e x °)-e x ° 

1 H — s$ . 

a (1 - b)a(e x ° - 1) 

Therefore for a large class of examples we have a computable direct bound on the rate 
of convergence even for general ergodic Markov chains. 

If 7r(C) is unknown then we have to treat it as a parameter and use a bound on a. As 
for the upper bounds we can use (13.4)) . on the other hand we show in Corollary I A. 31 that 
if bu(C) = b then a ^ b^ 1 . Since in the same way as in the atomic case (1 + s( "' r) 
increases with b assuming that b,L,R are fixed, thus we can always assume a #J b^ 1 . 
Let a = max{±ef (1 + a,), ±e| + \^ b a 2 }. 
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Theorem 3.3 Let b% b, and b(r) satisfies ([Oj). Then 

_ i 

fo = min{i?, (1 — 6) , _ min fo(a)}, 

6 _1 ^5:^fe _1 ao 

where f (d) is the unique solution of the equation 

r = (1 H y —L\W^P> . 

a 

Moreover for r < r 



|*[=r 



sup i yj(ti n — Moo)^! ^ -^o( r j : inax 



n=0 



6-i<s<6-ia (r - l)(a- 1 D(a) - r R ( a > r ) + 1)' 



We show in examples that the approach presented in Theorems 13.11 13.31 is comparable 
with the coupling method (see Section 7 in pQ for short introduction). Therefore we 
obtain the computable tool for the general question of rates of convergence of ergodic 
Markov chains under the geometric drift condition. 



4 Proof of main result 

In this section we give a proof of Theorem 12.81 

Proof.[of Theorem 12.8] Let b(z) and u(z) be the complex generic functions for 6 i; i ^ 1 
and Ui, i ^ sequences respectively. The main tool we use is the renewal equation fl2.ll) . 
i.e. 

l-b(z) = —-, \z\ < 1. 
u[z) 

Note that the equation remains valid on the disc \z\ ^ R in the sense of analytic functions. 
By Theorem 12.71 we learn that < oo and the renewal generic function Yl^=o( Un ~ 
u 00 )z n is convergent on some disc with radius greater than 1. Denote c(z) = i> ^_~ 1 (cf. 
proof of Theorem 3.2 in pQ) and observe that c(z) is well defined on \z\ ^ R, because 
c(R) = flli 1 = < oo. Since Uoo = c(l) -1 we have that 

oo 111 
X> n - = U(Z) - c(1)(1 _ z) = T - W) - c{1){z _ 1} = 

- 1 ( 1 1 )_ ^)-^) 1 (41) 

1- c(l) ; 2-1 c(l)c(z)' 1 ' ' 

The main problem is to estimate \c(z)\ from below, to which goal we use the simple 
technique 

\c(re ie )\ = \c(e i9 )\ - \c(re i9 ) - c(e ie )\ = \c(e i9 )\ - c(r) + c(l). (4.2) 
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Consequently the problem is reduced to the study of the lower bound on |c(e i6l )|. We 
recall that by the definition q = ^ 5> j bj and c(l) = Ci - To provide a sharp estimate 
in (14. 2p we benefit from the fact that for ^ < \9\ ^ j, I ^ 1, there is a better control 
on the first I summands in c(e ld ) = Y2°jLi c j e ^ 9 ■ First we note that 

11 n \l-e i6 \ ' \\-e ie \ 

which is equivalent to 

l c l e I' - \\-e*\ 
The geometrical observation gives that for < \9\ ^ j 
i i 
lei + - e *')l ^ l c < + - e *)l = l c < + C 1 - oX 1 - e *)L 

hence we conclude that 

|c(e")| > q|1 - e^r'dl + (1 - ^(l - e")| - 1). 
Since 1 — q ^ 6, for Z ^ 1 we see that 



\l + {l-c l )cJ 1 {l-e ie )\>Jl + bcf\l-e 



1 2 



It remains to verify that f(x) = x l [yl + bx* — 1] is increasing, which is assured by 



bx 



2 



f'( x ) = - x - 2 (Vl + bx 2 - 1) + x~ 2 ^= ^0. (4.3) 



Therefore we finally obtain that for ^ < |#| ^ j 



c e 



^' ^Q|l-e^|(A/l + ^ 2 |l-e#r| 2 -l). (4.4) 



Due to (14. 3 P and (14. 4p . when estimating the global minimum of |c(e J0 )| it suffices to find 
the bound from above on q|1 — e 1 ^ 5 "! -1 . We will show that 

17T , ITT -| 

Q |l _ e U+T)|-i ^ (1 _5)|1 _ e i+^|-i ; (4.5) 

where we recall that a = (c(l) — 1)/(1 — 6). First observe that (14. 5 p is trivial for I ^ a, 
since q ^ (1 — b) and |1 — e^ 1 1 ^ |1 — e' i -+ a \ . On the other hand for I > a the inequality 
holds 

ci\l - errr\- 1 ^ (c z Z)(Z|l - e^l)- 1 ^ (q/)(«|1 - e^l)" 1 . (4.6) 
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Using that c(l) = Y^=o c j we deduce 

i 

cil < c i ^ C W - 1 = a(l - 6) (4.7) 

and thus combining ( |4.6p and (14. 7p we obtain that 

ci\l - e^| _1 < (1 - 6)|1 - e^| -1 , 
which is ( 14. 5p . As we have noted the bound used in (14. 3p implies that 



|c(e ie )| ^ (1 - 6)|1 - e^\- l {\fl + b(l - fo) 2 1 1 - e^\ 2 - 1), 
which is equivalent to 

\c{e i9 )\ ^ |1 - e^\-\\(l -b) + 6(1 - e^)| - (1 - b)). (4.8) 
Plugging (14.81) into (14.21) we derive 

w«-)i > ia-^Mi-e^)i-(i-» _ c(r) + c(1) . 

|1 — e i+a| 

Finally using ( 14. ip we conclude that 

sup | X>, - u^\ < c(1)(r _ 1)((1 ll )D (l 1 ) ) _ c(r) + c(1)) ' 
where -D(a) = |1 — ei+° | _1 (|1 + rzr(l — ei+«)| — 1) which completes the proof of Theorem 



5 Comparing with the previous bounds 

We recall that our bound on the radius of convergence is of the form mini<; Q .g ao (l + 
^M)^sj_ a s it will be shown, this bound is always better than the main bound in [1] 
(Theorem 3.2). Then we turn to study the reason for this improvement. Using the limit 
case with b, L fixed and R — >■ 1, we check that the minimum of (1 + ^^-)^> can be 
attained in the interval [l,«o] an d that it is data depending problem. On the other 
hand we stress that in the usual setting this minimum of will be attained at atQ. The 
intuition for this phenomenon is that the smaller is ir(C) the worse rate of convergence 
we should expect. However it is possible to choose b, R, L in a way that this intuition 
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fails and then the minimization procedure is in use. Below we describe how to transform 
the minimization problem into solving some equation. 

Observe that the minimum of the function (1 + is attained at the unique point 

a that satisfies 

i N-l , , D(a). D(a) + a , ri . 

log — -r = log a + log 1 + v 1 5.1 

1 — b a V(a) — aV'{a) 

Obviously to find the minimum on the interval [1,ckq] the solution of (15 .ip must be 

i 

compared with 1 and «o- Consequently r$ = (1 + Z^l))^ 1 ) when such a is smaller than 
1 and ro = (1 + D ^°^ ) k( ° o) when it is bigger than ao, otherwise the solution of ( 15. ip is 
the worst possible a that minimizes our bound on the radius of convergence. The same 
discussion concerns maximization of K (r). Clearly the problem reduces to finding the 
maximum of the function a(D(a))~ 1 (r K ^ — 1) which is attained at the unique point a 
that satisfies the equation 

(l + ^)(r"<"> ^r« M 
D(a) log it 

To find the maximum of a(D (a)) -1 (r K ^ — 1) on [1, a ] we compare the solution of (I5.2p 
with 1 and ao- If such a is greater than ao then 

a {D(a ))- l (r K ^ - 1) 

is the optimal bound on maxi^ Q ^ ao a(D(a))~ 1 (r K ^ — 1). Similarly if a ^ 1 then 
(/}(l))~ 1 (r K ( 1 ) — 1) is the bound and otherwise the solution of (15.21) is the point maximum 

for max Ka<f(0 a(_D(a)) -1 (r K(Q) - 1). 

Remark 5.1 It is possible that our Lyapunov function is as good that we predict R as 
the lower bound on the radius of convergence of Y^m=o{ u n — Uoo)z n . Here it is the case 
when the solution of 115. 1\) is smaller than 1 i. e. when 

(l + ^Xit^-i)^ 1 ). 

We turn to show computable bounds on K (r) in the case when 7r(C) is unknown. Note 
that function D(a) is decreasing and therefore D(a) ^ D(a>o). Consequently one can 
rewrite Corollary 12. 1 11 with D(a) replaced by D(ao) and in this way obtain new bounds: 
Ki(r) ^ K (r) and r\ ^ r , where r\ = min{i?, min 1 ^ Q , s g ao (l + D( -"°^ ) «(°) } and 

r K{a) _ i 

KAr) = max 



i^a (r - l)(D(a )a- 1 - r K (°) +1 ) ' 
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Consequently to find K\(r) it suffices to compute the maximum of a(r K ^ a ' — 1) on the 
interval [l,ao]. The maximum of a(r K<Q ' ) — 1) is attained at a that satisfies 

( r *<«) _ i) = j^r K ^. (5.3) 

There is explicit solution of (15. 3p of the form 

N — 1 . log r . i°g« 

Again the solution must be compared with 1 and which finally provides the direct 
form of K\(r). 

Corollary 5.2 Suppose that b\ ^ b and b(R) ^ L. 
1. //l^f^(l-gi)^ 1 ' then 

sup | f> n - Uoo )z n \ < K^r) = (r- - 

\ z \= r n=0 ^ > 



log ft 



2. //l^^=i(l_gi)T5F<ad, ^en 



sup 

N= r n=0 

! (l-6)D(a )togiZ _ togr 
" l J u iV-1 logr 1 log/T - 

5. ften 



logi^ 

£>(a ) 

sup 1 * ' - " 1 " - ' " ' ' " 

\z\=r 



£K - «oo)*1 < *i(r) = (r - l)- 1 ([ ao(r : (ao °;- 1) - 



n=0 

Corollary 15.21 implies the following expression for r\ . Let ^ be the unique 

solution of 

N-l log r io&r 

a = - r(l-; = logr 5-5 

l — o log R 

if t|z^ ^ e and x a = 1 otherwise. 

Corollary 5.3 Suppose that b\~^-b and b(R) ^ L. Let f be the unique solution of 

(l-b)D(a ) logr logr log^ 

= 1 )logr 

N-l logiT \ogR J 

if f ^ x\ then r\ = (1 + D{a§))~^ , if x\ ^ r ^ x ao i/ien ri = r and if r ^ x ao t/ien 



n = + 



D(ao)^ 
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Clearly r\ ^ r , we turn to show that r\ is a better bound than in Theorem 3.2 in pQ. 
For this reason denote by r 2 the unique solution of 

r - 1 1 b 



r hg 2 (R/r) 2N 
Our aim is to show that r 2 $C r\. First observe that by the definition 



(5.6) 



D{a ) 



a 

for some a £ [1,cko]. Again by the definition R K ^ = (N — 1)/((1 — b)a), which implies 
that 

, \ - 1 . K(Q) 1 _ (1 - b)R^D(a ) 

K(a)r, ^ r y ' — 1 > . 5.7 

r x N - 1 v 7 

By the following inequality 



y ;i-6)2 + 4 6sin^(^)-(l-6) 6 

2(l-6)sin(^) > (l-b)(l + a y 



we obtain in ( 15 .7p 



i \ r i (a) n - 1 & , K 

V > RK (a) n ' (l + ao )(JV-l) V 



It suffices to note that (1 + olq) ^ 2k(q;o) ^ 2n(a), which is the consequence of n(ao) ^ 
ht(a) and the fact that 

M ao - 1 
~R^T } 



R n(a ) = R i 



which can be used to show that for a given R, the function «(o;o)/(l + cxq) is increasing 
with qj - Thus since k(«o)/(1 + «o) = 1/2 for ct = 1 we deduce that (1 + qj ) ^ 2fc(ao). 
Plugging the estimate 2ft(a) ^ (1 + a ) into (I5.8P we derive 



R K ( a ) n 2{N - 1)' 

It remains to check that k{o) = 2/ \og(R/ri) is the point maximum of K,(a) 2 (ri/ R) 
which follows that 

r 1 1 ^ be 2 



k{ol) 



n -l\og 2 (R/ ri ) 8(N- 1)' 
This shows that ri ^ r 2 and in fact r 2 can be treated as the lower bond in the worst 
possible case of our result. We stress that using «o instead of the minimization over all 
«o usually gives a major numerical improvement. 

To provide a rough argument for exploiting the parameter «o we consider the simplest 
renewal model where there are only two possible states 1 and «o (for simplicity assume 
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that «o £ N). Then the optimal rate of convergence is closely related to the specific 
solution of bz+ ^~^ 0-1 — o, namely it is the inverse of the smallest absolute value of 
the solution of the equation. Denoting the root by zq one can show that 

2ovr 2 . . , 

M = 1 + (1 _ b y a 3 + °(«o ), (5-9) 

(see discussion after Theorem 3.2 in pQ) and «o is exactly our parameter. Therefore 
whenever the estimate (1 + D ^°°- ) ) k ( q o) is applied one cannot improve it up to numerical 
constant. We turn to study this phenomenon in the limit case where b,L are fixed and 
R->1. 

Corollary 5.4 Suppose that R — > 1 and b\ ^ b, b(R) ^ L. 
1. //(^)/logf^^e 1/2 , then 

ro(R) = 1 + ^ ( ( f_~ 6 ) 2 )3 lo S' 2 (^) - !)/ lo S Y^) + " i) 3 )' 



5. //(^/logf^^e^ ft 



en 

r (R) = l + be ^ R Jl ) T +o((R-l)% 

Proof. Observe that lim a _ 5 . 00 aD(a) = 2 (i-b) 2 ' thus we can treat 7r6(2(l — o) 2 a) _1 as the 
right approximation of D(a) when a tends to infinity. As we have stated in Corollary 
EUTJto find 

D(a) i 

r Q (R)= inf (l + _^)^5j (5.10) 

one should solve the equation (I5.ip . i.e. find a(R) that satisfies 

!og i , = loga + log 1 + V 5.11 

l — o a -L>(a:) — 

where iV(ii) = (L — 1)/(R— 1), and compare the outcome with 1 and ao(R)- In particular 
we deduce from (15.111) that a(R) necessarily tends to infinity when R — y 1, hence using 

hm (1 + — - log 1 + -^) = 1 and hm (1 - ^r^) = 2 ' 
we obtain that 

1 , N(R) - 1 
log a(R) = -- + log + o(l). 
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The solution must be compared with ato(R) therefore if 

& a N (R)R-i = T^b < eh 

we have to use a(R) (at least for small enough R) when minimize (1 + ^^-)~^ over 
[1, ato(-R)], otherwise ocq(R) is the point minimum. In the first setting we have 

a (R) = e ~i — — - + o(l), and «(a(i2)) = + o(l), 

thus using (I5.10p we obtain that 

, s , D(a(R)) s i D(a(R)) 
r (R) = 1 + ™ = 1 + , p " + o i2 -1=1+ 

+ 2(1 - 1 w(«w) + o((fl " + + o{(R ~ in 

In the same way if l°g _1 (irf ) ^ el//2 > then 



«b(i2) = -7Ti + «(a (fl))= (L _ b , +o(l) 

R-l (R- 1) log(^, 

and hence 



, N , DWft)), i D(a (R)) 

rt <K(*-U) = 



2(1 - 6) 2 og(i2)/c(ao(i2)) 
7r6(i? — l) 3 0/ L — b x , ■>,. . ,L — b x . ,, 
= 1 + 2(1 - 6)' g ( T^6 } bg ((L " 1}/ l0g( T^6 )} + ° {{R ~ 1} } - 

It completes the proof of the corollary. 

■ 

In particular Corollary 15.41 shows that whenever j^r ^og~ 1 (j^) ^ the following in- 
equality holds 

roiR) = 1 + 2(1 -bya&R) K (a (R)) + } ' 

which when compared with (15.91) proves that our result cannot be improved up to a 
numerical constant (we recall that (1 + olq)/2 ^ k(o,q) ^ a ). On the other hand 
Corollary 15.41 makes it possible to compare our result with Theorem 3.2 in pQ. The 
following estimate holds for r2 (see Section 3 in [1]) 

^) = i + e gff r^ 3 +o((R-m. 
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Therefore if L — 1 much larger than 1 — 6 our answer is better on (L - 1)/(1 - b) 2 and 
if L — 1 is close to 1 — b then on L — 1. 

Nevertheless there are indeed two cases depending on b, R, L either L is far from 1 with 
respect to b, L and then the minimum of (1 + is attained on ao(R). However it 

may happen that L is close to 1 (again with respect to b and L) and then we have to use 
the minimization inside [l,«o(-R)] even for R—tl. It explains that the minimization of 
our bound on r for a G [1, a ] is important in our discussion. 



6 Applications to the geometric ergodicity 

In this section we follow our discussion from the introduction. We start from the atomic 



case, note that Proposition 12.21 is the classical first entrance last exit decomposition rule 
considered in two cases in order to obtain better bounds on Mw(r). To show this it 
suffices to carefully read the proof of Proposition 4.2 in [lj. In Theorem 12.41 we have 
stated the best form of such an estimate in case of W = 1. To obtain the result we 
need a small modification of Proposition 4.2 [Tj, we give the argument for the sake of 
completeness. 

Proof. [of Proposition l2~3] To show the first inequality it suffices to observe that r~ l Hi(r, x) 
attains its maximum on the interval [1, A -1 ] at A -1 . Using Proposition 12.11 we obtain 
that 

Irr / \ \ / \ 1 \ G(A-V) - 1 V(X) ~ 1 

T^Hfax) ^ Affi(A , x) = \ ' \ — ^ 



A- 1 -! " A- 1 -! 



Consequently H\(r : x) ^ rX (v^(x)-i) ^ x ^ q anc | j n same wa y we s how that H\{r, x) ^ 
if x G C. The second inequality can be derived in the similar way, first we note 
that r _1 (r — l) _1 (if 1 (r, a) — rH\(l, a)) is increasing and then we use the bound 

A i7 1 (A- 1 ,a)-A- 1 i7 1 (l,a) < f^X ~ 1 _ K-l 



r(K-X) 
1-A 



A- 1 -! 1-A (1-A) 2 

■ 

Theorems 12.41 and 12.61 are clear consequence of Proposition 12.21 and the bounds we have 
proved, which completes the atomic part of the discussion. 

In the general case we do not require C to be an atom. However, there is a simple 
trick (cf. Meyn -Tweedie [12], Numellin [10]) which reduces this case to the atomic one. 
Consider the split chain (X n , Y n ) n ^, defined on state space S = S x {0, 1} with the a-field 
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B generated by B x {0} and B x {1}. We define transition probabilities as follows: 
P(Y n = l\^,^_ 1 ) = bl c (X n ), 



V{X n ,A)-bl c (X n )v(A) 



if Y n = 0. 



l-61 c (X n ) 

where J-jf = cr(X& : ^ k ^ n), J 7 ^ = <j{Y)~ : ^ k ^ n). Thus the chain evolves 
in a way that whenever X n is in C we pick Y n = 1 with probability 6. Then if F n = 1 
we chose X n+ \ from z/ distribution whereas if Y n = then we just apply normalized 
probability measure version of P(X n , •) — blcv- The split chain is designed so that it 
has an atom S x {1} and so that its first component (X n ) n ^ is a copy of the original 
Markov chain. Therefore we can apply the approach from the previous section to the 
split chain (X n , Y n ) and the stopping time 

T = min{n ^ 1 : Y n = 1}. 

Let P x ,i, E X j denote the probability and the expectation for the split chain started with 
X = x and Y = i. Observe that for a fixed point a G C we have P x ,i = Pa,i and 
E x l = E tt> x for all x G C. Following the method used in the atomic case we define 
the renewal sequence u n = P a ^i(Y n = 1) and the corresponding increment sequence 
b n = P 0jl (T = n) for n > 1. Clearly u n = P a ,i(X n G C, Y n = 1) = bP v {X n _ x G C) for 
n ^ 1, so 

\ = bv{C) ^ b, and = 6tt(C). (6.1) 

We define 

G(r,M) := E^(r T ), H w (r,x,i) ^^(Jr^ft)), 

n=l 

for all a; G <S, i = 0, 1 and all r > for which the right hand sides are well defined. We 
also need the following expectation 

E x : = (1 - 6l c (aO)E x , + bl c (x)E Xjl , 

which agrees with the usual E x on J zX . There exists a unique stationary measure 7f 
say, on (S,B), so that J gn = J gdn (where g(x) = g(x,0) = g(x, 1) for all x G S). In 
particular we have that W(S x {1}) = lm(C). The first entrance last exist decomposition 
leads to the following result (cf. Proposition 12.21 and Proposition 4.3 in jTJ) 

Proposition 6.1 For all a G S x {1} 



Uoo)Z n \ + 



oo „ oo 

sup | yj(P n ff(a) — / gdn)z n \ ^ H w (r, a, 1) sup | ^(« n — 

l 2 l= r n=l ^ W =r n=0 

+MO ^ (r ' a ' 1) ~ r ^ (1 ' a ' 1) , (6.2) 
r — 1 
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and for all x G S x {0} 

oo „ 

J2(P n 9(x) - / gd-K)z n \ < 

n=l ^ 



sup 

oo 

< /fjyO"> 0) + G(r, x, Q)H w (r, a, 1) sup | ^(w n - u (y0 )z n \ + 

\ z \= r n=0 

+k(c) %(r,a,l)-r%(l,a,l)g (r[X]Q) + 
r — 1 

+fa((;)%(l 1 a,l) r( ^' X '" ) ' 1) . (6.3) 

r — 1 

Therefore one has to estimate all quantities in the above result. We move the exact cal- 
culations to the appendinx as well as the examples with computations of the convergence 
rate for some toy examples. 



Appendix A 

A.l Global bounds 

Our method described in Corollary 13.11 implies that 

oo 

sup | ^(u n - Uoo)z n \ < K (r) for 1 < r < r . 

W= r n=0 

The first step is to replace the stopping time T by r = t C - For this reason we define 

T 

G(r,x,i) = E^r T , H w (r,x,i) = ^rWft)). 

n=l 

Let also G(r) = sup x£C E Xj0 r T , H w (r) = sup x6C E^o Yln=i rn W(X n ). In the Lemma A.l 
in pQ there are proved following inequalities: 

Proposition A.l For r A -1 and (1 — b)G(r) < 1 £/ie inequalities hold: 

^, -\ „ b~G(r,x,i) . . „. 

G(r -'-' ) ^ i-d- slew (A - 1) 

and 

H w (r, x, i) < F w (r, x, i) + - ^ A ^ (A.2) 

In the introduction we have explained that the crucial for our approach is to establish 
(13.31) . We have all necessary tools to get the result. 
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Proposition A. 2 For all a G C and 1 $C r ^ min{A 1 , (1 — 6) } 

-. . . br br + Cb — 6)r a2 . . 

G r, a, 1 < max{ — , \ A.3 

V ' ' ; l l - (1 -b)r 1+ ^ l-(l-6)r V ' 

where a\ = log ( (jE^ ) / l°g ^ ~ 1 > a 2 = log( ) / log A -1 . Moreover if 1 + 6 ^ 26, 

^'■■' S-n-V ' (A - 4) 

For all x E S, 1 ^ r ^ min{A _1 , (1 — 6) } 

61 c (x) + (1 - 61 c (x))G(r, x, 0) < i _ ™}f )rl+ai • (A.5) 
Proof. The split chain construction implies that for any a G C 

(1 - 6) sup G(r, x, 0) + bG(r, a, 1) = sup G(r, x) = G(r). (A.6) 

Moreover due to bv{C) ^ 6 we have that bG(r, a, 1) = 6$^fcli Py(cT = k — l)r k , where 
a = inf{n ^ : X n G C} has its first coefficient greater or equal 6. Therefore by our 
usual argument with the Holder inequality we deduce that 

_ _ log r _ _ log r 

(1 — 6) sup G(r, x, 0) ^ (1 — 6)rt> lo g A_1 , and, bG(r, a, 1) ^ br + (6 — 6)™ io s A_1 , 

where u = G(A _1 , a, 1), v = s\xp xe0 G(\-\x,0) verify 

A _1 (6 + (6 — b)u + (1 - b)v) = supG(A _1 , x) < KX^ 1 , u,v^l. (A.7) 

xec 

Observe that by (IA.1I) we have the following bound 

_ _ log r 

. bG(r,a,l) . 6r + (6 — 6)ru 1 °s A ~ 1 ) , 

G ( r ' a ' ^ < i n ^? S < ^ = SIT" ( A ' 8 ) 

l-(l-6JG(rJ i_(i_5) rt; i^T 

One can check that the bounding function F(u,v) is convex for all (u,v) that satisfy 
(1A.7j) and hence it takes its maximum on the boundaries of the set given by (1A.7I) . 
Consequently due to (1A.8j) we obtain that 

-. , br br + Cb — b)r 1+a2 . , , , 

G(r, B ,l)< m «{ 1 _ (1 _ t)rl ^ , r L j -^ ; }. (A.9) 

It is easy to check that whenever 1 + 6 ^ 26 then (1 — b)ai ^ (6 — 6)«2 and the maximum 
in (1A.9j) can be replaced by the first quantity for any r ^ 1. Otherwise if 1 + 6 < 26 then 
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(1 — b)ai < (6 — 6)a 2 and therefore for small enough r the maximum in 0A.90 must be 
attained at the second expression. 

We turn to show the second assertion. Observe that by Proposition ^. II we have G(r, x, 0) = 
G(r,x) ^ V(x) for all x £ C. Consequently (lA.lj) yields 

C(^.°X 1 -S) G (r) - (A ' 10) 

for all x (jL C. Since obviously G(r) ^ r 1+ai we deduce that 
On the other hand by flA.lj) 



G{r,x,0)^ 



1 - (1 - 6)r 1 + c 
for all x G C and therefore 



6 + (1 - b)G(r, x, 0) < i _ (i _ - )rl+Qi (A.ll) 



for all igC. Since V ^ 1, inequalities ( lA.lOj) and (lA.llj) imply (1A.5j) . 



The next step is to obtain the estimate fl3.10p . 

Corollary A. 3 The following inequality holds 

- , Hi(l, a, 1) — 1 -i ,1 — 6. , 1 — 6 b — b^ - 

b < , < fe max { i r 1 + «i , i 7 + z r" 2 } = b'W A.12 

l — o l — o 1 — 1 — 

Proof. As for the first assertion we simply apply ( 1A.3j) to bound f/i(r, a, 1) = rG ^'°'^~ 1 
and then tend with r to 1. To prove the second assertion let S = max{fc ^ 1 : ^ T}, 
where r^, /c ^ are subsequent visits to C by (X n ) n ^ , in particular r = 0. Observe 
that 

oo 

#i(l, a, 1) = E aj i(^ l<^ fc (r fc - r fc _i)). 

fc=0 

Therefore by the construction 

a, 1) ^ E„(l + a) + E a>1 (£ - 1), 

where we recall that a = mm{n ^ : X n G C}. Since S has the geometric distribution 
with the probability of success b we obtain that 

Hi(l,a,l) ^ b' 1 + E u a. 
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It remains to notice that E u a ^ 1 — v{C), therefore if bv(C) = b then 



H x {l,a,l)>b- x + l-\, 

b 



which completes the proof. 



Now we state an improvement of the result mentioned in the proof of Proposition 4.4 in 

DP- 

Proposition A. 4 For r A -1 and (1 — b)G(r) < 1 we have that 

H w (r, a, 1) < = sup # w r, a; + -= , n V " ( A ' 13 ) 

b xec b 1 - (1 - o)G(r) 

and 

Hw(r, a, 1) — rf/^(l, a, 1) ^ = swp(Hw(r, x, 0) — rH w (l, x, 0)) + 

b xac 

+^-H w (r)(G(r,a,l)-l). (A.14) 
b 

Proof. To prove the first assertion note that (1A.6I) can be rewritten as 

bG(r, a, 1) < sup 3 . eC (G(r,x) - 1) 
1 - (l-6)G(r) ^ 1 - (l-fe)G(r) 



Combining the above inequality with (IA.2j) we derive 



ft / ,\ tt / ,\ 1 b . . (1 — b)H w (r) sup Tpr (G(r, x) — 1) 
iMr, a, 1) < i%(r, a, 1) + -^-H w (r) + K - 5(1 _ (1 ^ (r)) 

Since the definition of H w (r,x, 1) implies that 

bH w (r, a, 1) + (1 — b)H w (r) ^ sup H w (r, x) 

x&C 

we obtain OA. 130 . To show the second assertion we use S = max{/c ^ 1 : ^ T} 
defined in the proof of Corollary IA.3I The following inequality holds 

Hw{r, a, 1) — rH w (l, a, 1) < H w (r, a, 1) — rH w (l, a, 1) + 

oo 

+ Ea.ifljKs sup(r Tfc - 1 F w (r, x, 0) - r# w (l, x, 0))]. (A.15) 

fc=2 xeC 

As we have shown in Corollary IA.3| E a ^(S — 1) = (1 — 6)/6 we deduce that 

oo 

^(E ai il fcsSAr ) sup(H w (r, x, 0) - rH w (l, x, 0)) 

2 

1-6 



, sup(# w (r, x, 0) - r-Hw^ljXjO)), 
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which together with flA. 15[) provides 



H w (r, a, 1) - rH w (l, a, 1) < H w (r, a, 1) - rH w (l, a, 1) + 

1-6 

+^^- sup{H w (r, x, 0) - rH w (l, x, 0)) + (A.16) 

xdC 

oo 

k^Ny k 1 — l)]sapH w (r,x,0). (A. 17) 

k=2 X£C 



As usual we observe that 

H w (r, a, 1) - rH w (l, a, 1) + 
1 - b 

H — r — supf-ffy^fr, x, 0) — rH w (l, x, 0)) ^ 

x&C 

^ i sup(# w (r, x) - r# w (l, x)). (A.18) 

o zee* 

Moreover since Y Tk is independent of t^-i we have E 0i ir rfc - 1 1^5 = (1 — b)E at ir Tk - 1 lk-i^s 
which implies that 

oo oo , oo 

and thus 

^[E a>1 W(r^ - 1)] = _(E a>1 (r r - 1)) = -^-(G(r, a, 1) - 1). 

fc=2 

Consequently 

oo 1 — 6 

y)[E 0i il fc< j V (r 7 *- 1 - l)]sup^(r,x,0) = -^-H w {r){G{r, a, 1) - 1). (A.19) 



Combining (jA.17jl . (IA.18jl and (IA.19jl we conclude that 



H w (r, a, 1) — rifw(l, a, 1) ^ = sup(iJvi/(r, x, 0) — rifvy(l, x, 0)) + 

o sec 

' ~ b H w (r)(G(r,a,l)-l). 



b 

It completes the proof of (1A.14j) . 
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A.2 Case of W = 1 

In the case of W = 1, the above result gives an improvement in #i(r, a, 1) — r#i(l, a, 1) 
estimation, which as we have mentioned in the introduction, can be used in the part of 
the proof where supui =r | ^^L (Mn — Woo)| is considered. 

Proposition A. 5 The following inequalities hold 

(1 _ ilM „o) < + ^gg^M , (A,0) 

/or ad i G 5, H r ^ min{A _1 , (1 — } ; 

^■"■• a - 1 ) S-( 1 - 1 6)^. r( f-'A A) < A ' 21) 

/or all a £ C, 1 ^ r ^ min{A _1 , (1 — 6) } and 

gi(r,a,l)-rgi(r,o,l) 1 rA(AT - 1) 
r-1 ^ 6 (1 - A) 2 

1 (i- )( r i+ ai _i) r (^-A) 

6(r-l)(l- (l-by+ a i) 1-A ' 1 ' J 

/or all a <E C, 1 ^ r ^ min{A _1 , (1 - 6) _T ^"}. 
Proof. By flA.2j) we have that 

Together with i?i(r, x, 0) = i/i(r, x) and G(r, x, 0) = G(r, x) ^ V(a;) for x G" C it follows 
that 

x rr / n (l-b)Hdr)V(x) 



Consequently by Proposition 12.31 

rA(V(x) - 1) (1 - 6)(G(r) - l)rV(x) 



#i(r,x,0) ^ 



1-A (r-l)(l-(l-6)G(r))' 
Using G(r) ^ r 1+a we deduce that 

^ l(r ' X '° K 1-A + (r-l)(l-(l-o)r^)' [ } 

for all x (jLC . On the other hand if x G C, then (IA.2I) implies that 

H,(rxO)<H,(r)(l+ (1 ~ 5)G(r) )= for x G C 

11 ' Uj ^ l[r)[ + 1 - (1 - 6)G(r) j 1 - (1 - b)G(r) ' 
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Hence again by G(r) ^ r 1+ai 



- - (1- b)(r 1+ai - l)r 

:i-t)g,(r,»,0)< j_ » j IbrxeC. (A.24) 



From (1X723]) and (17Q4|) we conclude ( TOO]) . 
Observe that flA.lj) and (I A . 6 1) imply that 



- r(G(r,a,l) - 1 sup xgC r(G(r, x) - 1) _ sup xeC Hi(r, x) 

u ' ' ; r -l " (r-l)(l-(l-6)G(r)) l-(l-6)G(r) 



(A.25) 



and therefore 



^ / n < sup a 6c(-gi(y,g)) < r(K- A)_ 

11 ' ' J " 1 - (1 - 6)r 1 +«i " (1 - A)(l - (1 - 6)r 1 +«i 



which is ( 1A.21|) . To prove the last assertion we use (1A.14I) and (1A.25h . which imply that 



Hi(r, a, 1) — rHi(l, a, 1) ^ = sup(ifi(r, x) — rHi(r, x))+ 
(l-&)#i(r)sup, eC (G(r,x)-l) 



1 - (1 -b)G{r) 
The above inequality is equivalent to 



i^i(r, a, 1) — ri?i(l, a, 1) ^ = sup(f/i(r, x) — rHi(r, x)) + 

b xec 

| (l-5)(G(r)-l)BU P , 6C g 1 (r,a;) 



1 - (1 - 6)G(r) 

Clearly Hi(r,x) = r ( G ( r ^)~ 1 ) ; thus by Proposition 12.31 we obtain that 
H!(r,a,l)-r^i(l,a,l) 



r — 1 



lrA(K-l) (1 - 6)(G(r) - 1) r(K - A) 

^ I (1-A) 2 + 6(r-l)(l-(l-6)G(r)) 1-A ' 

Due to G(r) ^ r 1+ai we deduce (lA.22j) and complete the proof of the result. 

■ 

The consequence of Propositions 16.14 IA.2I and IA.5I is the following theorem in the non- 
atomic case. 

Theorem A. 6 Suppose (X n ) n ^ satisfies conditions U\-$E form the introduction. Then 
(X n ) n ^o is geometrically ergodic - it verifies hi. 2^1 and we have the following bounds on 
Pv, Mi: 

Pv < 1 
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and 



2Ar 2(1 -o)(r 1+ai - l)r b rX(K - 1) 

MAr) ^ - + - — v - A =— ^ — - + 



+ 



1-A (r- 1)(1 - (1 -6)r 1 +«i) l _ (l - &) r i+«i (1 - A) 2 
(r - l)i?o(r) + 6(1 - b){r 1+ai - 1) r{K - A) 
(r - 1)(1 - (1 -6)r 1+Q i) 2 1-A ' 



where K Q (r) = K (r,b,b, X l ,KX l ), r = r (b, b, X 1 ,KX x ) are given in Theorems IJ.il 
and HO. 



Proof. Note that bir(C)Hi(l,a, 1) = 1. We apply Proposition 16.11 in the way that we 
sum (16.21) with weight (1 — blc(x)) and (16.31) with weight blc{x). Then we use flA.5j) to 
bound bl c (x) + (l-bl c (x))G(r,x,0) and flA~20l) to bound (1 -&l c (x))#i(r, x, 0) = (1- 



6l c (a:)) rQ(r '^ 1 0) ~ 1 . Finally ( IMT| and flX22|) are estimates for H(r, a, 1) and (H x (r, a, 1)- 



TH x {l,a,l))l(r-\). 

■ 

A.3 Case of W = V 

The second case we consider is when W = V. 

Proposition A. 7 The following inequalities hold 

r /ufr/ , Xr(V(x)-l) .K-rX T , rV(x) /A , 

(1 - bla(x))H v (r, x, 0) < L-U^ + (y^y - ^ (1 _^ rW (A.26) 

/or all x G 5, 1 ^ r ^ min{A _1 , (1 — 6)~ 1+Q i } ; 

, — -,r(if-rA) - ,,K-rX - x r-1 r(if - A) /A 

H v (r,a, 1) < fe -1 ^ r^ + 6 r - 6) ; r 1 , A.27 

VK ' ' ; 1-rA v l-rA ; 1 - (1 - 6)r 1+Q i 1-A ' V ; 

for all a G C , 1 ^ r ^ min{A _1 , (1 — }, m particular a, 1) ^ 6 _1 yfy ; 

H v (r,a,l)-rH(l,a,l) - , r(K - 1) 

r-1 ^ (l-A)(l-rA) 

- i — rA - 1 r(K-X) , . , 

+"-'<— -"> !-(! -6)^. 1-A ' < A ' 28 ) 

/or alia eC, 1 < r < min{A _1 , (1 - 6) _T ^T}. 
Proof. We recall that (1A.2j) implies that 

(l-b)H v {r)G(r,x,0) 



H v (r,x,0) < #y(r,:r,0) + 



1 - (1 - o)G(r) 
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Therefore since Hy(r,x,0) = Hy(r,x) and G(r,x,0) = G(r,x) for all x (jL C we can use 
Propositions 12.11 and 12.51 to get 

Sv(riIj0)< M5H) + d-i)WW 



1-rX 



for all x G" C. Similarly for x G C 



{l-b)H v {r,x,0) ^ {l-b)H v {r){l + 



1 - (1 -b)G(r) 



(l-fc)G(r) . (l-b)H v (r) 



l-(l-b)G(r) J l-(l-b)G(r) 
Hence using G{r) ^ r 1+ai we obtain that 

Therefore it suffices to bound (1 — b)Hy(r), note that 

bH v (r,x, 1) + (1 - b)H v (r) ^ supify(r,x), for all x G C. 

Clearly Hy(r,x, 1) ^ r, so by Proposition 12.51 we deduce that 



(1 - b)H v {r) ^ r( f ^ -Sr, 
1 — rA 



(A.29) 



which establishes (|A.26|1 . To show the remaining assertions we use bounds flA.13j) . f )A.14jl 
and flA.6[) obtaining that 



rr / -\ i rr / \ t i (1 — b)H v (r) snp rpC (G(r, x) — 1) 

# y r, a, 1) < 6- 1 sup H v (r, x) + b~ iy - VK ' ^g, \ '- 

xgc 1 - (1 - b)G(r) 



and 



H v (r, a, 1) — rH v (r, a, 1) < b sup(H v (r, x) — rH v (l, x)) + 



+ b 



-l (1 - b)H v {r) sup x&c {G{r, x) - 1) 



1 - (1 -b)G(r) 
Recall that G(r) ^ r 1+ai and by Propositions 12. II and fT. 



G(r,x)-1 K - X TT . . r(K-rX) 
< -. H v (r,x) ^ 



r — 1 



1-A 



1 - rA 



consequently 



M ( ^ ^ -,-i r{K - rX) ^ (r-l^l-pHy^ K-X 
^ (r ' fl ' lK6 ^7x~ + b l-(l-6)r^ 1-A 
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Together with (1A.29j) it completes the proof of (I A . 2 7|) . Finally the same argument shows 

H v {r,a,l)-rH v {r,a,l) < r-i r{K - 1) - x (l-b)H v (r) K-X 

r-1 ^ (l-A)(l-rA) 1 - (1 - b)r 1+ai 1 - A ' 

Again by ()A.29j) we obtain (IA.28|) . which completes the proof. 

■ 

Propositions 16. 1\ IA.2I and IA.7I imply the estimate in the most general case when there is 
no control on W but V. 

Theorem A. 8 Suppose (X n ) n ^ satisfies (I2P-|3|). Then (X n ) n ^ is geometrically ergodic 
- it verifies U.fy) and we have the following bounds on py, M±: 



Pv ^r l 



and 



ti r / \ Ar ,K — rX 



1-rX y 1 - rX ' 1 - (1 - b)r 1+a i 

K -X, rX (1 - b)(r 1+ai - l)r . 

H ( 1 = — ) + 

1 - A 4 - A (r - 1)(1 - (1 - &)r!+^) 

b r(K-l) 

+ l-(l-6)r 1 +«i ( (l-A)(l-rA) + 

K-rX - 1 r(K - A) 

+ { l-rX 'l-il-by+ai 1-A } + 

K (r) r(K-rX) A - rA - r-1 r(K - A) 

+ 1 - (1 - ^ 1 - rA + M - rA ~ ^ 1 - (1 - 6)^+^ 1-A 

where Ao(r) = Ao(r, b, b, A -1 , AA -1 ), fo = r"o(&, 6, A -1 , AA -1 ) are given in Theorems lff.il 
and HO. 

Proof. Observe that 7r(C) ^ 1. As in the proof of Theorem I A. 6 1 we we use Proposition 
16.11 summing (16.21) with weight (1 — blc(x)) and (16.31) with weight blc{x). Again we use 
(lA~5l) to bound bl c (x) + (1 - bl c (x))G(r, x, 0), then (lA~26|) . (TA271) . (IA~28|) to bound re- 
spectively (1 — blc(x))Hv(r, x, 0), Hv( r , a , 1) and (Hy(r, a , 1) — r Hy{l, a, l))/(r— 1). We 
use also the bound #y(l,a, 1) ^ ^f^x and ( EOUj) to bound (1 - bl c {x))Hx(r, x, 0) = 
(l-tlcW) ^" 1 . 



Appendix B 

We compare our result with what was shown in [1] as a numerical test for the presented 
approach. 
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B.l The reflecting Random Walk 

We consider the Bernoulli random walk on Z + with transition probabilities P(i, i — 1) = 
p > 1/2, P(i, i + 1) = g = 1 — p for i ^ 1 and boundary conditions P(0, 0) = p, 
P(0, 1) = g. We set C = {0} and V(i) = (p/q)^ 2 , and compute A = 2 v /pg, K = p + ^/pq, 
b = p and = 7r(C) = 1 — q/p. The optimal radius of convergence for the reflecting 
random walk is A. 
Consider two cases: 

1. In the first one we consider p = 2/3, so b = 2/3, A = 2^/3, K = (2 + V2)/3, 
Moo = 1/2. 

2. In the second one we set p = 0.9, and hence A = 0.6, K = 1.2, b = 0.9, Uoo = 8/9. 

We compare our result in Table 1 below, where p, pc denotes estimates on the radius 
of convergence in the case where respectively is known or not. We use Optimal 
for the true value of the spectral radius and Bednorz, Baxendale, Meyn-Tweediel and 
Meyn-Tweedie2 respectively for our Corollaries 12.91 and I2.11[ Baxendale's Theorem 3.2 
PQ, Meyn-Tweedie's result given in [T3] and its improved version (see Section 8 in pQ for 
details). 



Table 1 






p = 2/3 


P 


Pc 


Optimal 


0, 9428 


0, 9428 


Bednorz 


0,9737 


0,9737 


Baxendale 


0,9994 


? 


Meyn — Tweediel 


0,9999 


0,9988 


Meyn — Tweedie2 


0,9991 


0,9927 


p = 0,9 


P 


Pc 


Optimal 


0,6 


0,6 


Bednorz 


0,6 


0,6 


Baxendale 


0,9060 


? 


Meyn — Tweediel 


0,9967 


0,9888 


Meyn — Tweedie2 


0, 9470 


0,9467 



B.2 Metropolis Hastings Algorithm for the Normal Distribu- 
tion 

In this example we consider the convergence of a Metropolis-Hastings algorithm in the 
case when we want to simulate n = A/"(0, 1) with candidate transition probability q(x, •) = 
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Af(x, 1). The example was studied in [T3] and also in 
definition P(x, •) is distributed with a density 



and [15J. By the algorithm 



p{x,y) 



exp( 
exp( 



(y-x) 2 



), 



(y-x) 2 +y 2 -x 2 



if \x\ ^ \y\ 

), if M < \y\- 



The natural setting of the problem is to consider Lyapunov functions of the type V(x) 
e s ' x ' and C = [—d,d\. Consequently (see [1] for details) 



A 



PV(d) 



K = PV{d) = e sd X 



The computed value for p depends on d and s, and hence to we need to find the optimal 
ones. Moreover to compare our result with the previous contributions to the problem, 
let v be given by 

v(dx) = cexp(—x 2 )lc(x)dx, 
for a suitable normalizing constant c. In this case, v(C) = 1 and we have 

b = b= V2exp(-d 2 )[$(v / 2rf) - 1/2]. 

In this case we work with the additional complication of the splitting construction. 
The results are compared in Table 2, where again Bednorzl and Bednorz2 denote our 
Theorems 13.31 and 13.11 (depending whether or not we use the additional information on 
7r(C)), Baxendale denotes what can be obtained by Baxendale's Theorem 3.2, Coupling 
denotes the estimate obtained by the coupling approach (see Section 7 in [TJ and [17] ) 
and Meyn-Tweedie the result obtained in the original paper [13] . Note that we compare 
methods that no additional assumptions on the transition probabilities are made. 



Table 2 

Bednorzl 
Bednorzl 
Baxendale 
Coupling 



d s 

0.96 0.065 

0.92 0.169 

1 0.13 

1.8 1.1 



0.00000529 
0.00005496 
0.00000063 
0.00068 



Meyn-Tweedie 1.4 0.00004 0.000000016 



Another possible choice of v is 
bvidx) - 



exp (-^±^)da;, 
exp(— d\x\ — | x | 2 ) do: , 



if \x\ ^ d 
if \x\ > d 
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In this case 



b = 2($(2d) - and 6 = 6 + v / 2exp(c/ 2 /4)(l - $(3d/V2)). 

Using the same notation as in Table 2 we compare the results below. 

Table 3 

d s (1-p) 
Bednorzl 1.03 0,0733 0,00001061 
Bednorz2 0.97 0, 1740 0, 00013637 . 
Baxendale 1 0,16 0,0000017 
Coupling 1,9 1,1 0,00187 

Observe that our method is bit worse than coupling yet it is relatively simple (does not 
require further examination of the Lyapunov function V.) 



B.3 Contracting Normals 

Here we consider the family of Markov chains with transition probability P(x, •) = 
H{9x 1 1 — 9 2 ) for some parameter 9 G (—1, 1). The family of examples occurs in [T6] as 
one component of a two component Gibbs sampler. The example was discussed in [I], 
[H] and [15]. Here we take V(x) = 1 + x 2 and C = [— c, c]. Then (j2J) is satisfied with 



2 



X = 9 2 + 2 1 —^-, K = 2 + 9 2 (c 2 -l). 
1 + c z 



The we choose v concentrated on C so that 



bu(dy) = mm — =exp( ; 7^r)dv 

K U> **c ,/2tt(1 - # 2 ) Pl 2(l-# 2 ) ; y 



for y £ C. Integrating with respect to y gives 

We compare our answer Bednorzl, Bednorz2 ( Theorems 13 . 3 [ I3TT1 r esp . ) with the coupling 
method Coupling and Baxendale2 an approach based on Kendal type result (Theorem 
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3.3 in [T]) that requires invertibility of the transition function. 

Table 4 





9 


c 




l-p 


Bednorzl 


0,5 


1, 


5 


0,000872023152 


Bednorzl 


0,75 


1, 


2 


0, 000000964524 


Bednorzl 


0,9 


1- 


1 


0, 000000000004 




e 


c 




l-p 


Bednorzl 


0,5 


1. 


5 


0, 002754672439 


Bednorzl 


0,75 


1. 


2 


0,000017954821 


Bednorzl 


0,9 


1. 


1 


0,000000000881 









c 


l-p 



Baxendalel 0,5 1,5 0,050 
Baxendalel 0,75 1,2 0,0042 ' 
Baxendale2 0,9 1,1 0,00002 

9 c l-p 

Coupling 0,5 2,1 0,054 

Coupling 0,75 1,7 0,0027 

Coupling 0,9 1,5 0,00002 

B.4 Reflecting random walk, continued. 

Here we slightly redefine our first example. Let P(0, {0}) = 1 and P(0, {1}) = 1 — e for 
some e > 0. We concentrate on the difficult case, when e < p, that was studied in [15] 
and [5]. Note that when e ^ p then the chain is stochastically monotone and then the 
result of Tweedie [7] apply. Let V(i) = (p/q)^ 2 , C = {0} as earlier. Then A = 2^/pq, 



K — £ + (1 — s)yjp/q and b — e. In this example we can calculate the formula on b(z) 
which is 

b{z) = G{z, 0) = £Z + (1 - £)zG{z, l)=£z + -^(1 - (1 - Apqz 2 ) 1 / 2 ), (B.l) 

Zq 

for \z\ < 1 / y/Apq, where the formula for G(z, 1) is from [4]. Consequently 

7r ({0})-i = fr'(l)=e+ 2p(1 ~ £) . 

p-q 

On the other hand (IB.ll) leads to the optimal bound on the radius on convergence which 
is 

pq+(p-e) 2 jf £ < P-Q 



P 



2\/pq~i otherwise. 
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We compare Bednorzl } Bednorz - our Corollaries 12 . 9|I2 . 1 1 1 with results Fort and Baxendale 
that denotes respectively the result of Fort [5] and Baxendale's Theorem 1.2 pp. Note 
that both two methods use further properties of transition probability in this particular 
example. 



Table 5 










p = 0,6 


e 


= 0,05 


e = 0,25 


£ = 0,5 


Optimal 





9864 


0,9798 


0,9798 


Bednorzl 





99993 


0,9994 


0, 99783 


Bednorz2 





99993 


0,9994 


0,9977 


Fort 





9997 


0,9995 


0,9994 


Bax 





9909 


0,9798 


0,9798 


p = 0,7 


e 


= 0,05 


e = 0,25 


£ = 0,5 


Optimal 





9165 


0,9165 


0,9165 


Bednorzl 





9992 


0, 9940 


0.9783 


Bednorzl 





9991 


0,9935 


0.9779 


Fort 





9964 


0,9830 


0,9757 


Bax 





9731 


0,9165 


0,9165 


p = 0,8 


e 


= 0,05 


e = 0,25 


£ = 0,5 


Optimal 





9633 


0, 8409 


0,8000 


Bednorzl 





9970 


0,9780 


0,9266 


Bednorzl 





9964 


0,9751 


0,9253 


Fort 





9793 


0,9333 


0,9333 


Bax 





9759 


0,8796 


0,8000 


p = 0,9 


e 


= 0,05 


£ = 0,25 


£ = 0,5 


Optimal 





9559 


0, 7885 


0,6250 


Bednorzl 





9927 


0, 9489 


0, 8408 


Bednorzl 





9899 


0,9358 


0,8280 


Fort 





9696 


0,8539 


0, 7500 


Bax 





9687 


0, 8470 


0,6817 


p = 0,95 


e 


= 0,5 


£ = 0,25 


£ = 0,5 


Optimal 





9528 


0, 7679 


0,5556 


Bednorzl 





9888 


0, 9249 


0, 7827 


Bednorzl 





9841 


0,9024 


0,7537 


Fort 





9564 


0, 7853 


0,5814 


Bax 





9645 


0, 7853 


0,5814 
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